Crawling PTA & Berita#

!pip install builtwith
Collecting builtwith
  Downloading builtwith-1.3.4.tar.gz (34 kB)
  Preparing metadata (setup.py) ... ?25l?25hdone
Requirement already satisfied: six in /usr/local/lib/python3.12/dist-packages (from builtwith) (1.17.0)
Building wheels for collected packages: builtwith
  Building wheel for builtwith (setup.py) ... ?25l?25hdone
  Created wheel for builtwith: filename=builtwith-1.3.4-py3-none-any.whl size=36077 sha256=b6a543532b9a72bcc885e42ed132ed0b2752c2ea799c79cbd14b4e79b856140e
  Stored in directory: /root/.cache/pip/wheels/7f/2d/b2/606e3df914d4aeeab99c4a4e3e9a61673d2293c2e346db00c8
Successfully built builtwith
Installing collected packages: builtwith
Successfully installed builtwith-1.3.4

1. Crawling PTA#

import builtwith

# Analisis teknologi yang digunakan
res = builtwith.parse('https://pta.trunojoyo.ac.id')
print(res)
{'web-servers': ['Nginx'], 'javascript-frameworks': ['jQuery', 'jQuery UI']}